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SYSTEM AND METHOD TO PROVIDE AUDIO ENHANCEMENTS AND 
PREFERENCES FOR INTERACTIVE TELEVISION 

5 TECHNICAL FIELD 

This disclosure relates generally to user-selected audio preferences, 
and in particular but not exclusively, relates to user customization of audio to 
accompany content on an interactive television system. 

10 

BACKGROUND 

Multimedia content provided over conventional television systems or 
over the Internet offer little or no ability for the user to modify the audio 

15 accompanying this content. In a television broadcast, the user cannot change the 
audio portion of the broadcast. The audio content of the television broadcast is 
predetermined before reaching the television viewer and allows no customization by 
the television viewer. 

At many Internet web sites, there is no audio available while viewing 

20 web page content. An Internet user sometimes can select an MPEG type file to be 
downloaded or streamed to their computer. In these cases, however, the user is not 
provided methods to change the audio portion of the multimedia presentation, but 
rather, is passively receiving audio content that has been pre-selected for the web 
site by its operator. Some Internet web sites provide background music while a user 

25 is viewing its web pages. However, such web sites typically do not offer the user the 
opportunity to select from different choices of music. In many situations, the music 
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turns off when the user changes to a different web page of the web site, such that 
the music does not accompany the perusal through the entire web site. Sometimes, 
the only option available to the user to turn the music off or on, and even then, it is 
often difficult for the user to turn such audio off— the audio launches automatically 
5 upon opening of the web page or controls for the music are difficult to locate and 
use. 

Some web sites provide a pre-recorded human voice, upon user 
request, to give audio instructions that aid the viewer in navigating their site. These 
sites, however, offer little or no ability for the user to modify the human voice audio 

10 content to their personal preferences. The user cannot select different human 
voices (e.g., male, female, male child, etc.) or otherwise personalize what the pre- 
recorded human voice says. 

Thus, while some Internet web sites do offer audio content and some 
simple control over the audio content, customization to suit a particular user's 

15 preferences are often lacking. As described above, user customization of audio 
content for television is virtually unavailable. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Non-limiting and non-exhaustive embodiments of the present invention 
are described with reference to the following figures, wherein like reference 
5 numerals refer to like parts throughout the various views unless otherwise specified. 

Figure 1 shows an example of a system that can implement an 
embodiment of the present invention. 

Figure 2 is a block diagram of an example client terminal for the 
system of Figure 1 that can implement an embodiment of the present invention. 
10 Figures 3-8 illustrate examples of actions that can be conducted using 

the system and client terminal of Figures 1 and 2, respectively, according to an 
embodiment of the invention. 
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DETAILED DESCRIPTION 

Embodiments of a method and system to allow user customization of 
audio content on interactive television are described herein. In the following 
5 description, numerous specific details are provided, such as the description of the 
system and various components, to provide a thorough understanding of 
embodiments of the invention. One skilled in the relevant art will recognize, 
however, that the invention can be practiced without one or more of the specific 
details, or with other methods, components, materials, etc. In other instances, well- 

10 known structures, materials, or operations are not shown or described in detail to 
avoid obscuring aspects of the invention. 

Reference throughout this specification to "one embodiment" or "an 
embodiment" means that a particular feature, structure, or characteristic described 
in connection with the embodiment is included in at least one embodiment of the 

15 present invention. Thus, the appearances of the phrases "in one embodiment" or "in 
an embodiment" in various places throughout this specification are not necessarily 
all referring to the same embodiment. Furthermore, the particular features, 
structures, or characteristics may be combined in any suitable manner in one or 
more embodiments. 

20 As an overview, an embodiment of the invention provides a user the 

ability to select the audio accompanying content viewed on an interactive television 
system. For example, the user can elect to listen to jazz style music while viewing 
content on a shopping channel accessed over interactive television. Alternatively or 
in addition, the user can be provided with an instructional voiceover that guides the 

25 user through a purchase experience on the shopping channel. In accordance with 
an embodiment of the invention, the music selections or instructional voiceovers can 
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be uploaded by the user to a server, and then played on the shopping channel (or 
other channel) when the channel is later viewed. The music or voiceovers can be 
selected from a menu, preset to play automatically, or can play in response to 
clicking an icon or other visual indicator. Implicit or explicit profiling may also be 
5 used in an embodiment to determine the music or voiceover to play to the user. 

Figure 1 is a block diagram depicting a system 100 for distributing 
television content and Internet content in accordance with an embodiment of the 
present invention. The system 100 can be integrated with a cable television 
distribution system. The system 100 includes an Internet 102, a plurality of content 

10 sources 104, a plurality of distribution centers (depicted as head-ends or H/E) 106, 
and a plurality of client terminals (depicted as set top boxes or STB) 108. In 
addition, a content source 104 is depicted as receiving data from remote data feeds 
112, advertisement servers 114, image sources 116, streaming video sources 118, 
and audio content servers 122 or other sources/servers. In one embodiment, 

15 caches and/or servers including, for example audio content servers 122 or the like, 
can also be coupled to head-ends 106. 

In the embodiment shown in Figure 1, the plurality of content sources 
104 is coupled to the Internet 102. For example, a content source 104 may 
comprise a web site portal such as Go2Net.com, or a news web site such as 

20 CNN.com, or other types of sources. Each content source 104 may have various 
data feeds 112, servers 1 14/122, and sources 1 16/1 18 coupled to it. 

For example, news or stock quote feeds 112 may be fed into the 
content source 104. Servers 114 may provide advertisements for insertion into 
multimedia content delivered by the content source 104. Servers 122 may provide 

25 storage of content, such as stored audio content, stored television content, stored 
Internet content or the like, which may be later provided over communications 
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channels or networks 120 or the Internet 102 on demand to distribution centers 106. 
Sources 116/118 may provide images 116, streaming video 118, and other content 
to the content source 104. Various other feeds, servers and sources may also be 
coupled to the content source 1 04. 
5 The Internet 102 comprises a network of networks and is well known in 

the art. Communications over the Internet 102 are accomplished using standard 
protocols such as transmission control protocol/internet protocol (TCP/IP), hypertext 
transfer protocol (HTTP), file transfer protocol (FTP), or other protocols. The 
Internet 102 is coupled to the plurality of distribution centers 106 (which may 

10 comprise a cable head-end), and each distribution center 106 is in turn coupled to a 
plurality of client terminals 108. As examples, the client terminal 108 may comprise 
a set top box (STB), a personal computer, an interactive television set, a 
conventional television set, an audio device, a wireless device (such as a cellular 
telephone), or another type of communication device. 

15 It is noted that the Internet is chosen as an example of a data 

communications network because it is a well-established network, and connectivity 
to the Internet is easily made. However, it is noted that a global communications 
network, such as the Internet, is not required to practice other embodiments of the 
invention. A locally provided and maintained communications network may be used 

20 in an embodiment. 

In alternative or in addition to the Internet 102 being used to distribute 
multimedia content from the content sources 104 to distribution centers 106, 
communications channels or networks 120 apart from the Internet 102 may couple 
one or more content sources 104 to one or more distribution centers 106. One 

25 example of such an alternate path for communications is illustrated by the first 
dashed line 120 in Figure 1 . Other configurations are also possible and meant to be 
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included within the scope of the present invention, such as a peering connection 
between distribution centers 106 illustrated by a second dashed line 124 in Figure 1. 

The audio content servers 122 coupled to the distribution centers 106 
may include (or be coupled to) caches. Such caches may be used to increase the 
5 performance in the delivery of audio content to the client terminals 108. For 
example, files for audio and other high-bandwidth content may be stored in such 
caches, which may be closer to the client terminals 108 than to the content sources 
104. In addition, reliability and guaranteed bandwidth may be provided because the 
Internet 102 is not in-between such caches and the client terminals 108. 

10 In accordance with one embodiment of the invention, different or 

multiple portals may be used to access the information provided through the 
interactive video casting systems of figure 1-3, based on the type of client terminal 
being used by the end user. That is, for example, a television portal may be 
provided for an end user that uses the television set 154 to access the information. 

15 A PC portal may be provided for an end user that uses a PC to access the 
information. Portals can be provided for end users that use the cellular telephones, 
PDAs, audio devices, etc. to access the interactive video casting systems of Figures 
1-3. 

Such portals may be provided in several possible ways. In one 
20 embodiment, the client terminal {e.g., the end user's display device or audio device) 
can be suitably configured with an adapter that includes hardware and software. 
The adapter converts the television signals, the Internet or web page content, or 
other information provided from the interactive video casting system into a digitized 
format or other format that is compatible with the operational features of the client 
25 terminal. 
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In another embodiment, the cable provided 108 can deliver signals 
having different formats to the various client terminals, with the client terminals not 
necessarily having special adapters. Therefore, as an example, the cable provider 
108 or other party can generate/deliver information (e.g., television programming, 
5 web page content, etc.) having a format that is compatible for end users that receive 
the information via the television set 154. The cable provider 108 or other party can 
also generate/deliver the same information (e.g., simultaneously with the television 
portal on the same communication link, separately on a different communication 
link, on-demand independent of the television portal, etc.) using a format that is 

10 compatible with end users that receive the information via PCs, PDAs, cellular 
telephones, etc. Thus, the term "interactive video casting system" is used to 
describe generally a system that can deliver video information over any network and 
any network-compatible device by broadcasting, multitasking, or unicasting. An 
"interactive television system" is one type of or one means of access to an 

15 "interactive video casting system". 

Figure 2 is a block diagram illustrating an example embodiment of a 
client terminal 108 in accordance with the teachings of the present invention. In one 
embodiment, the client terminal 1 08 may be referred to as a set top box (STB) and 
can include a user interface 257 including for example a hardwired, a wireless 

20 infrared (IR) or radio frequency (RF) transceiver or the like, that can exchange 
signals 214 with a remote control unit or other user input device. The client terminal 
108 can be a component that is separate from a television set, or its features can be 
built into circuitry of the television set (e.g., an interactive television set). The client 
terminal 108 enables a viewer to select a television program to view and then 

25 delivers the television program to a television set. 
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A storage medium 204 can also be coupled to or be a part of the client 
terminal 108. The storage medium 204 can comprise a machine-readable storage 
medium such as random access memory (RAM), read-only memory (ROM), buffers, 
caches, memory, diskette, compact disc (CD), digital versatile disc (DVD), tape, or 

5 the like and their associated hardware, in one embodiment. In another embodiment 
the storage medium 204 can include a video cassette recorder (VCR). In another 
embodiment, the storage medium 204 can include a hard disk and provide a digital 
or personal video recorder (DVR or PVR) capability to the client terminal 108. 

As shown in the example depicted in Figure 2, an embodiment of the 

10 client terminal 108 also includes a processor 202 to read and execute software, 
machine-readable instructions, code, or other information stored in a machine- 
readable medium (such as the storage medium 204), with such software capable to 
control operations of components of (or components coupled to) the client terminal 
108. In one embodiment, the information stored by the storage medium 204 can 

15 include, but not be limited to, software to operate the client terminal 108, network 
communication software, cached/buffered Internet content (such as uniform 
resource locators or URLs, web pages, applets, and the like), user input information 
exchanged with remote controls, or audio clips to be uploaded to the audio content 
server 122. 

20 An embodiment of the client terminal 108 further includes a network 

interface 206, such as for example a digital cable modem or modem interface, a 
digital subscriber line (xDSL) interface, a satellite dish interface, an antenna to 
receive high definition television (HD television) broadcasts, or other suitable 
interface to communicate with the distribution center 106. In one embodiment, the 

25 use of an antenna or the like enables the network interface 206 to receive terrestrial 
broadcasts when communicating with a distribution center 106. The network 

9 
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interface 206 enables communications with the sources 104 and/or the Internet 102 
to receive, for example, television content and Internet content. In one embodiment, 
the network interface 206 may include a back channel interface including, for 
example, a modem or the like to communicate with a communications network such 
5 as the Internet 102. A television set interface 208 provides a communication 
interface with a television set, a plurality of television sets, or other output devices, 
such as home stereo or home theater equipment or other suitable audio and/or 
video output equipment. Miscellaneous components 210 of the client terminal 108 
can include various controls {e.g., television set volume, picture, color controls, and 
10 the like), hardware, and software related to operation of the client terminal 108, 
which for the sake of simplicity are not described further herein because they would 
be familiar to those skilled in the art having the benefit of this disclosure. 
Components of the client terminal 108 are coupled to each other via one or more 
buses 212. 

15 Figure 3 illustrates a user viewing items on a shopping channel 302 

displayed on a television 304 via the television interactive television system 100. 
The shopping channel 302 shows a collection of merchants offering various 
products and services. The user can navigate the shopping channel 302 to view 
different products and services as well as gather information about the merchants. 

20 Once the user finds an item on the shopping channel 302, the user can purchase 
the item through the interactive television system 100. In one embodiment, the user 
navigates the shopping channel 302 and completes purchases using a user-input 
device that communicates with a client terminal 108, such as a remote control. 

The shopping channel 302 can be implemented in several possible 

25 ways. In one embodiment, the shopping channel 302 can be a "synthetic channel" 
that is specifically created and operated by a cable service provider, multiple system 
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operator, or other party. Merchants can subscribe to these parties to have their 
advertisements, storefronts, ad-fronts, URLs to the merchant's web sites, 
commercials, and the like provided via the shopping channel 302. The shopping 
channel 302 can include a televised catalog of the merchants' products, or 
5 otherwise provide access to the merchants' products for eventual perusal and 
purchase by the viewer. 

In an embodiment, the shopping channel 302 can comprise a 
collection of subscribing merchants' advertisements. In another embodiment, the 
shopping channel 302 can be a dedicated channel for each merchant, or can 

10 provide a single point of access to "sub-channels" of various merchants. The 
shopping channel 302 can also be embodied as scrolling text, somewhat analogous 
to scrolling television program listings. The scrolling text of the shopping channel 
302 can display available products of merchants. The shopping channel 302 can 
also be implemented to include any suitable combination of live video, recorded 

15 video, storefronts, advertisements, scrolling text, graphics, URLs, and the like. 

Figure 4 illustrates a situation where the user selects the audio content 
to accompany the shopping channel 302. The user is presented with a variety of 
audio content. The selection of available music audio content can be arranged by, 
but not limited to, by style of music (e.g., jazz, oldies, heavy metal, etc.), by 

20 individual song, by album, by artist, or by other classification(s). The user can also 
choose Internet radio stations as audio content. Audio content available for 
selection by the user also includes sound effects. The user can associate different 
sounds with various actions on the shopping channel 302, such as different sounds 
for clicking an icon, or when changing from one screen to another. In another 

25 embodiment, the audio portion of other content on the interactive television system 
100 can be selected to accompany the shopping channel 302. For example, a user 
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could choose to have the audio portion of a football game being shown on another 
channel as the audio content for the shopping channel 302. 

The interactive television system 100 stores the user's audio content 
selections as user audio preferences. The user audio preferences can be stored in 
5 the client terminal 108, in the head-end 106, in one or more servers in the systems 
shown in Figures 1, or in any suitable combination of these locations or other 
locations. 

In an embodiment, the shopping channel 302 can be provided with 
one or more default audio settings. Thus, when the user first subscribes to the 
10 interactive television system 100 and tunes to the shopping channel 302 for the first 
time, the user is presented with the default audio content. As an example, the 
default audio content for an outdoors merchant advertising in the shopping channel 
302 can have a theme that includes nature sounds, such as rushing water, chirping 
birds, and the like. 

15 If the user desires to change the default settings, audio selections 402 

in Figure 4 may be made from a menu, preferences screen, or via other selection 
technique. In accordance with an embodiment of the invention, the audio selections 
402 can be selected from audio, that is uploaded to a server by the user or other 
party, as will be described later below. Once the user's selections have been made, 

20 the selections can be stored as user preferences in an audio library collection and 
then applied during subsequent viewing of the shopping channel 302. 

It is to be appreciated that the audio enhancements to the shopping 
experience on the shopping channel 302 may have several variations. For instance, 
as the theme of the music changes, so does the look of the shopping channel 302 

25 (or vice versa). Thus, the audio enhancements that accompany the display of 
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products may change when the user is taken to a screen where the user has to 
provide credit card information to finalize the purchase. 

Figure 5 illustrates a situation in which the user can select audio 
content to assist in an action on the shopping channel 302. In Figure 5, the user is 
5 viewing the selections offered by the merchant "Shoetown." The user wants more 
information about a particular shoe 501. In one embodiment, the user can click on 
an "Info" icon 502 in a corner of the screen. The user hears the unique sound effect 
he has selected to associate with the "Info" button 502. The user can then click on 
the picture 501 of the shoe and an instructional voiceover gives more information 

10 about the shoe. In another embodiment, a voiceover can assist users as they go 
through the buying process. The voiceover tells the users how to enter credit card 
information, where to enter the mailing address, and so forth. 

Figure 6 illustrates a situation where the user can select a style 602 of 
voice played when the user selects an instructional voiceover on the shopping 

15 channel 302. The style of voices 602 include, but are not limited to, male, female, 
male child, a baritone male voice, a female New York accent, the voice of a famous 
actor, and the like. Thus, when the user wants instructions on the buying process 
on the shopping channel 302, the user hears the male voiceover the user had 
selected earlier. 

20 In one embodiment, the audio content is stored in the interactive 

television system 100. Audio content servers 122 store audio content that can be 
selected by the user. However, audio content servers 122 are not limited to storing 
audio content. Any server providing content to the interactive television system 100 
may be used to store audio content or other content, such as video or graphics. 

25 Figure 7 illustrates a situation where the user can upload audio content 

to the interactive television system 100 via a user interface 702. In one 
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embodiment, the user connects to the interactive television system 100 via the 
Internet 102 to upload audio content. The user can access the Internet 102 using, a 
conventional modem connection, a DSL connection, an integrated services digital 
network (ISDN) connection using a telephone line, a cable modem, a wireless 
5 connection, or the like. The audio content can be formatted as MP3, WAV, musical 
instrument digital interface (MIDI), or the like. The user can upload audio content to 
the interactive television system 100 via the Internet 102 using a personal computer, 
laptop computer, a personal digital assistant, a client terminal and the like that can 
display the user interface 702. The interactive television system 100 stores the 
10 uploaded audio content at a user storage medium. A storage medium for the 
uploaded audio content can be located in a set top box 108, in another device 
coupled to the television set 304, in a head-end 106, in one or more servers in the 
systems shown in Figure 1, or in any suitable combination of these locations or 
other locations. 

15 In one embodiment, the user can upload a human voice to the 

interactive television system 1 00 to be used as an instructional voiceover while the 
user is viewing the shopping channel 302. For example, a wife could speak into a 
microphone on a personal computer, a laptop, or the client terminal 108 and give 
instructions on how to complete a purchase. These instructions would be saved in a 

20 format as described earlier and then uploaded to the interactive television system 
100. Later, when the husband goes to purchase an item, he can listen to his wife's 
voice giving him instructions on how to complete the sale. Another example, a 
mother could upload instructions to her child not to make a purchase in an amount 
exceeding the child's weekly allowance. When the child proceeds to purchase an 

25 item, the mother's voice reminds the child not to spend too much money. 
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In another embodiment, audio content on the shopping channel 302 is 
provided through explicit profiling by the interactive television system 100. When a 
user opens an account on the interactive television system 100, the system asks the 
user questions regarding the user's audio content preferences. The user may also 
5 request that the system re-ask the questions at anytime. From the answers to these 
questions, the interactive television system 100 develops user audio preferences. 
The user's audio preferences can be stored in the client terminal 108, in the head- 
end 106, in one or more servers in the systems shown in Figures 1, or in any 
suitable combination of these locations or other locations. Thus, if the user does not 
10 actively select audio content pre-selected by the interactive television system 1 00 as 
described earlier, the interactive television system 1 00 provides audio content based 

on explicit profiling. 

In another embodiment, audio content on the shopping channel 302 is 
provided based on implicit profiling. The interactive television system 100 monitors 

15 the user's viewing habits. By analyzing which interactive television content the user 
watches and how long the user watches them, the interactive television system 1 00 
can develop user audio preferences. For example, if the user watches a lot of 
action television shows and movies, then the interactive television system 100 
creates a user profile of high energy, exciting music. However, if the user watches 

20 many old movies from the 1940s and 1950s then the interactive television system 
100 develops a user profile of big band music. User-selected audio content takes 
precedent over user audio preferences created through explicit profiling or implicit 
profiling in one embodiment. 

In another embodiment of the invention, the user can select the audio 

25 to accompany other content on the interactive television system 100. Other content 
of the interactive television system 100 includes, but is not limited to, Internet 
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content and user objects. In one embodiment, the user uses the same methods as 
described above to select music while viewing Internet content on the World Wide 
Web (WWW). Thus, the user could select to listen to jazz music whenever the user 
opens a portal to view content on the World Wide Web. In another embodiment, the 
5 user can select the audio content to accompany interactive television user objects. 
These user objects include, but are not limited to, a user calendar, a user address 
book, a user recipe book, and the like. Thus, the user could select audio content so 
that whenever the user reviews his user calendar on the interactive television 
system 100 (as depicted at 802 in Figure 8), the accompanying audio content is 

10 music by Mozart. In other embodiments, the explicit and implicit profiling methods 
described above can be used to develop an audio content user profile that can be 
applied to other content on the interactive television system 100. 

In one embodiment, a user could view more than one interactive 
television content at a time. For example, with a "picture in picture" feature, a user 

15 could be watching a baseball game and place the user calendar 802 in the upper 
right corner of the television screen. The audio content correlates to the active 
window. Thus, if the user calendar 802 is the active window, then the audio content 
selected for the user calendar 802 becomes the audio content heard by the user. 
The user could choose to turn off the user calendar audio content, or choose to 

20 keep the user calendar 802 as the active window, but select the audio content of the 
baseball game. 

Several techniques may be used to provide audio enhancements to 
the user while the user is viewing the shopping channel 302, including application of 
the user's preferences so as to provide customization of the audio enhancements. 
25 In one embodiment, triggers such as Advanced Television Enhancement Forum 
(ATVEF) triggers, can be embedded in the television signals sent to the client 
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terminal 108. The triggers point to locations, such as to a URL address of the audio 
content sever 122, where the corresponding audio content may be retrieved for 
playback when a screen of the shopping channel 302 is displayed or when an icon 
is clicked by the user. The triggers embedded into the television signal can point to 
5 storage locations where the user has uploaded audio clips. 

In another embodiment, the audio clips (or at least a portion thereof) 
can be transmitted to the client terminal 1 08 along with the television signals. The 
process of combining the audio with the video/images can be performed at a local 
studio, at the head-ends 106, at a master control location, or at other suitable 
10 locations in the interactive television system 100, such that stored audio clips and 
files can be retrieved and sent along with the video. In one embodiment, known 
television broadcasting, techniques can be used to provide the audio signals along 
with the video signals. 

In yet another embodiment, files such as HTML files, can be provided 
15 to the client terminals 108 as part of the storefronts or catalogs displayed on the 
shopping channel 302. The HTML files can include tags, Java Script, or other type 
of machine-readable instruction to retrieve the audio content from the audio content 
server 122 (or from some other location) when the storefronts or catalogs are 
rendered on the television screen. Alternatively or in addition, Java Script or other 
20 code can be activated to retrieve and play the audio content in response to the 
user's clicking of an icon or when switching from one screen to another. 

The above description of illustrated embodiments of the invention, 
including what is described in the Abstract, is not intended to be exhaustive or to 
limit the invention to the precise forms disclosed. While specific embodiments of, 
25 and examples for, the invention are described herein for illustrative purposes, 
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various equivalent modifications are possible within the scope of the invention, as 
those skilled in the relevant art will recognize. 

For instance, while embodiments of the invention have been described 
herein as providing audio enhancements for the shopping channel 302, it is to be 
5 appreciated that audio enhancements can be provided for other types of channels. 
For instance, audio enhancements can be provided as instructional voiceovers for 
a house-building program, rather than for a purchase experience. 

Furthermore, in addition to audio preferences, the user may set visual 
preferences. For example, the user may prefer to shop at the shopping channel 
10 302 during Christmas season, with decorative Christmas graphics or video 
displayed on the storefront. Such visual preferences can be selected or set via a 
menu, similar to selecting and setting audio preferences. Video clips may be 
uploaded to a server and played back in a manner similar to the audio clips 
described above. 

15 These modifications can be made to the invention in light of the above 

detailed description. The terms used in the following claims should not be 
construed to limit the invention to the specific embodiments disclosed in the 
specification and the claims. Rather, the scope of the invention is to be determined 
entirely by the following claims, which are to be construed in accordance with 

20 established doctrines of claim interpretation. 
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